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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- tf the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- tf NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )I3 Responsive to communication(s) filed on 03 September 2003 . 
2a)Q This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 1-3,5-8 and 15-21 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) S Claim(s) 15-21 is/are allowed. 

6) [3 Claim(s) 1-3 and 5-8 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
11 )□ The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) [3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (0- 

a)!3AII b)D Some*c)D None of: 

1 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) Q Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachment(s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 

2) Q Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-1 52) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) D Other: 
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1 . This action is responsive to communications: Amendment, filed on 9/3/2003. 
This action is non-final. 

2. Claims 1 -3, 5-8 and 1 5-21 are pending in this application. Claims 1 , 1 5, 1 6 and 
18-21 are independent claims. This action is non-final. 

This application claims foreign priority dated 6/1 1/99. 

3. The present title of the invention is "Marker Layout Method, Mixed Reality 
Apparatus, and Mixed Reality Space Image Generation Method" as filed originally. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1 ), (2), and (4) of section 371 (c) of this 
title before the invention thereof by the applicant for patent. 

The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act 
of 1999 (AIPA) and the Intellectual Property and High Technology Technical 
Amendments Act of 2002 do not apply when the reference is a U.S. patent resulting 
directly or indirectly from an international application filed before November 29, 2000. 
Therefore, the prior art date of the reference is determined under 35 U.S.C. 102(e) prior 
to the amendment by the AIPA (pre-AlPA 35 U.S.C. 102(e)). 
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5. Claims 1-3 and 5-7 are rejected under 35 U.S.C. 102(e) as being anticipated by 

Cohen et al. (US 6,222,937). 

As per claim 1, Cohen et al., hereinafter Cohen, disclose a marker layout method 
for laying out markers in a real space as position indices upon presenting a mixed 
reality space shared by a plurality of players, each of which is movable within a different 
movable range, comprising the step of: 

laying out the markers to have a positional relationship that allows a given player 
to observe only markers that are needed by the given player when plurality of players 
observe the mixed reality space within their respective different movable ranges ("The 
walls and base of the stage are inscribed with markers 605", column 7, line 18-19, and 
""various pre-defined vantage points" (column 7, line 50) are the observe points), 

wherein markers to be used by only the given player are laid out at positions 
hidden by real objects when the markers are observed from the other players ("The 
collection system automatically determines the vantage point of a picture by (1 ) 
identifying those markers not occluded by the object", column 7, line 24-26, thus, some 
markers hidden from some view points is observable from some other view points). 

6. As per claim 2, Cohen demonstrated all the elements as applied to the rejected 
claim 1 , supra, and further discloses a visible feature of the markers to be used by only 
the other players is similar to a visible feature of the markers to be used by only the 
given player (Figure 6, since the different players share the same processor and 
memory, it is anticipated the marker used are similar). 

7. As per claim 3, Cohen demonstrated all the elements as applied to the rejected 
claim 1, supra, and further discloses the visible feature includes at least one of color, 
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texture, shape, and size of the marker ("markers 605 colored a darker shade of cyan", 

column 7, line 18-19). 

8. As per claim 5, Cohen demonstrated all the elements as applied to the rejected 
claim 1, supra, and further discloses the real objects are laid out for an application that 
uses the mixed reality space (since Lumigraph system collects a synthetic or real object 
(or a scene), see Abstract). 

9. As per claim 6, Cohen demonstrated all the elements as applied to the rejected 
claim 1 , supra, and further discloses the markers to be laid out include markers shared 
by a plurality of players (since the markers are observable in a 3-D space, the markers 
not obstruct by objects can also be observed by some other players). 

10. As per claim 7, Cohen demonstrated all the elements as applied to the rejected 
claim 1 , supra, and further discloses the markers have a common color ("markers 605 
colored a darker shade of cyan", column 7, line 18-19, it would have been obvious to 
one of ordinary skill in the art to make the marker of the same color in order to make 
them to be recognizable). 

11. As per claim 8, Cohen demonstrated all the elements as applied to the rejected 
claim 1, supra, and further discloses computing and/or correcting location/posture 
information of a player using markers laid out by a marker layout method of claim 1 
(Figure 21 2105). 

Allowable Subject Matter 

12. Claims 15-21 are allowed. 
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As per claims 15-21 , the closest prior art by Cohen et al. do not explicitly disclose 

in a mix reality space image generation, a marker layout method the step of 

"A mixed reality space image generation step of generating a mixed reality space 

image to be observed by the player, so the player observes virtual object images that do 

not include any images of markers in marker regions including the markers from the 

image data, 

wherein said mixed reality space image generation step includes a step of 
substituting or overlaying images of the marker regions by predetermined virtual object 
images". 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Response to Arguments 

13. Applicant's arguments with respect to claims 1-3 and 5-8 have been considered 
but are moot in view of the new ground(s) of rejection. 

Conclusion 

14. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 



Inquiries 
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15. Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to Ryan Yang whose telephone number is (703) 308- 

6133. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi, can be reached at (703) 305-4713. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 305-47000377. 

Ryan Yang 
November 25, 2003 




